Recognizing Predictive Substructures with Subgraph Information Bottleneck

نویسندگان

چکیده

The emergence of Graph Convolutional Network (GCN) has greatly boosted the progress graph learning. However, two disturbing factors, noise and redundancy in data, lack interpretation for prediction results, impede further development GCN. One solution is to recognize a predictive yet compressed subgraph get rid obtain interpretable part graph. This setting similar information bottleneck (IB) principle, which less studied on graph-structured data Inspired by IB we propose novel (SIB) framework such subgraphs, named IB-subgraph. intractability mutual discrete nature makes objective SIB notoriously hard optimize. To this end, introduce bilevel optimization scheme coupled with estimator irregular graphs. Moreover, continuous relaxation selection connectivity loss stabilization. We theoretically prove error bound our estimation noise-invariant Extensive experiments learning large-scale point cloud tasks demonstrate superior property

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Information Bottleneck Approach to Predictive Inference

This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provi...

متن کامل

PICASSO: Exploratory Search of Connected Subgraph Substructures in Graph Databases

Recently, exploratory search has received much attention in information retrieval and database fields. This search paradigm assists users who do not have a clear search intent and are unfamiliar with the underlying data space. Specifically, query formulation evolves iteratively as the user becomes more familiar with the content. Despite its growing importance, exploratory search on graph-struct...

متن کامل

Predictive encoding: Recognizing opportunities

Suspended goals are those that are postponed by an agent because they do not fit into the agent's current, ongoing agenda of plans. Recognizing later opportunities to achieve suspended goals is an important cognitive ability because it means that one can defer work on a goal until one is in a better position to achieve the goal. This paper focuses on when and how such opportunities are recogniz...

متن کامل

Information Bottleneck Co-clustering

Co-clustering has emerged as an important approach for mining contingency data matrices. We present a novel approach to co-clustering based on the Information Bottleneck principle, called Information Bottleneck Co-clustering (IBCC), which supports both soft-partition and hardpartition co-clusterings, and leverages an annealing-style strategy to bypass local optima. Existing co-clustering method...

متن کامل

Conditional Information Bottleneck Clustering

We present an extension of the well-known information bottleneck framework, called conditional information bottleneck, which takes negative relevance information into account by maximizing a conditional mutual information score. This general approach can be utilized in a data mining context to extract relevant information that is at the same time novel relative to known properties or structures...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence

سال: 2021

ISSN: ['1939-3539', '2160-9292', '0162-8828']

DOI: https://doi.org/10.1109/tpami.2021.3112205